Geo-location video archive system and method

ABSTRACT

A system and method for recording, uploading, and archiving video recordings, including a front-end and a back-end application. The preferred embodiment of the present invention includes a front-end application wherein video is recorded using a mobile device. The recorded video is embedded with date, time and GPS location data. The video is stored on an online back-end database which catalogs the video according to the embedded data elements. The video may be selectively reviewed by relevant experts or emergency personnel for immediate response to the uploaded video and/or distribution to the proper parties. The video may also be archived for later review and use by any number of end-users.

CROSS REFERENCE TO RELATED APPLICATION

This application claims priority in U.S. Provisional Patent ApplicationSer. No. 61/448,997, filed Mar. 3, 2011, and is related to AUTOMATEDBIOMETRIC IDENTIFICATION SYSTEM (ABIS) AND METHOD, U.S. patentapplication Ser. No. 13/412,512, filed Mar. 5, 2012, which claimspriority in U.S. Provisional Patent Application Ser. No. 61/448,972,filed Mar. 3, 2011, and is also related to AUTOMATED BIOMETRICSUBMISSION AND IMPROVED SCANNING SYSTEM AND METHOD, U.S. patentapplication Ser. No. 13/095,601, filed Apr. 27, 2011, which claimspriority in U.S. Provisional Patent Application Ser. No. 61/328,305,filed Apr. 27, 2010, all of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present disclosed technology relates generally to a system andmethod for recording, uploading, and utilizing video recorded inreal-time, and specifically to a front-end and back-end video archivalsystem and method using video recorded in real-time to aid in emergencyor weather response.

2. Description of the Related Art

Digitally watermarking or embedding data into recorded video is wellknown in the art. Modern mobile phones, digital cameras, and othermobile devices are capable of recording video anywhere a user islocated, and uploading that video to common video archive websites, suchas youtube.com. These mobile devices may also include GPS functionality,allowing the video to be tagged with location data and other relevantdata so that anyone who ultimately views the video can determine whereand when a video was taken.

Presently, such mobile user-submitted videos may be uploaded to videoarchival or video sharing networks, but the value of the embedded videodata is typically underused. For instance, a video may be uploaded to apublicly available video archive database where numerous end users areable to view the video, but the video may not be used immediately andthe relevance of the time and location of the video that has beenuploaded loses value.

Typical video archive databases either include embedded video data as anafterthought, or limit the access of that data to selected users. Onesuch example of selective use of video data is U.S. Pat. No. 7,633,914to Shaffer et al. (the “914 Patent). Although video data may be uploadedand used for assessing critical security or other means in thegeographic area of the video data, the '914 Patent relies on users whohave already accessed “virtual talk groups” to upload relevant videodata. That video data is then only immediately accessible to members ofthe same virtual talk groups, which limits the effectiveness of thevideo data to a small number of users.

Embedded video or photograph data is also used by police departments foraccurate evidence collection. U.S. Pat. No. 7,487,112 to Barnes, Jr.(the “112 Patent”) describes this ability, but limits the use of theuploaded video or photographic data to the police department. Video orphotographic data uploaded to the collection server is stored and notimmediately used in any capacity. Such a technique merely simplifies thetasks of a police officer during evidence collection and does not fullyembrace the value of embedded video data.

What is needed is a system which provides mobile users the ability torecord video with embedded data, upload that video to a commonlyaccessible database where the video may be immediately reviewed, and anyparticular value that can be gathered from the uploaded video besubmitted to emergency crews or other relevant parties for immediatereview of the recently uploaded video. Heretofore there has not been avideo archival system or method with the capabilities of the inventionpresented herein.

SUMMARY OF THE INVENTION

Disclosed herein in an exemplary embodiment is a system and method foruploading and archiving video recordings, including a front-end and aback-end application.

The preferred embodiment of the present invention includes a front-endapplication wherein video is recorded using a mobile device. Therecorded video is embedded with date, time and GPS location data.

The video is stored on an online back-end database which catalogues thevideo according to the embedded data elements. The video may beselectively reviewed by relevant experts or emergency personnel forimmediate response to the uploaded video and/or distribution to theproper parties. The video may also be archived for later review and useby any number of end-users.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings constitute a part of this specification and includeexemplary embodiments of the disclosed subject matter illustratingvarious objects and features thereof, wherein like references aregenerally numbered alike in the several views.

FIG. 1 is a block diagram showing the relationship between the variouselements of the preferred embodiment of the present invention.

FIG. 2 is a flowchart showing the practice of a method of the preferredembodiment of the present invention.

FIG. 3 is a diagram illustrative of a user interface for viewing videoson a computer utilizing the preferred embodiment of the presentinvention.

FIG. 4 is a diagram illustrative of a user interface for viewingarchived video associated with the preferred embodiment of the presentinvention.

FIG. 5 is a block diagram showing the relationship between variouselements of an alternative embodiment of the present invention.

FIG. 6 is a flowchart showing the practice of a method of an alternativeembodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS I. Introduction andEnvironment

As required, detailed aspects of the disclosed subject matter aredisclosed herein; however, it is to be understood that the disclosedaspects are merely exemplary of the invention, which may be embodied invarious forms. Therefore, specific structural and functional detailsdisclosed herein are not to be interpreted as limiting, but merely as abasis for the claims and as a representative basis for teaching oneskilled in the art how to variously employ the present invention invirtually any appropriately detailed structure.

Certain terminology will be used in the following description forconvenience in reference only and will not be limiting. For example, apersonal computer including a display device for viewing a typical webbrowser or user interface will be commonly referred to throughout thefollowing description. The type of computer, display, or user interfacemay vary when practicing an embodiment of the present invention.

A preferred embodiment of the present invention relies on a front-endmobile application 3 associated with a mobile personal computing device7, such as a mobile phone, personal digital assistant, or otherhand-held computing-capable device. The mobile personal computing device7 must access a wireless network 16. A back-end mobile application 17may be accessed via any personal computing device with capable access toa network, such as the World Wide Web.

II. Geo-Location Video Archive System and Method

Referring to the drawings in more detail, reference numeral 2 generallyrefers to a geo-location video archive system, comprising a front-endmobile application 3, a back-end mobile application 17, and an end user30.

FIG. 1 demonstrates the relationship between the front-end application3, the back-end application 17, a wireless network 16, and an end user30. The front-end application 3 is comprised of a mobile device 7. Thismobile device 7 may be any hand held mobile device capable of recordingand uploading video data via the wireless network 16 to a databaseserver 18 utilized by the back-end application 17.

The mobile device 7 includes a camera 4 or other video capture abilitycapable of recording either still or video images, an antenna 6, aprocessor 8, a wireless network connection 10, a memory 12 storing anapplication 14, and a position reference 13.

The antenna 6 is capable of receiving and transmitting data over awireless network 16, such as image data recorded by the camera 4. Theprocessor 8 is adapted for processing all data required by the mobiledevice. The wireless network connection 10 allows the mobile device 7 toaccess the wireless network 16 for transmission and reception of data.The memory 12 stores all data necessary for the function of the mobiledevice 7, including image data recorded by the camera 4. An application14 for accessing the back-end mobile application 17 via the wirelessnetwork 16 is stored on the memory. The position reference 13 includesoptional two-dimensional or three-dimensional positional informationabout the mobile device 7. This positional reference 13 may optionallybe attached to image data recorded with the camera 4.

The primary purpose of the mobile application 7 is to capture highresolution video by use of the mobile device's 7 camera 4. Theapplication 14 will collect video in one to ten second slices andtransmit it with related data. This data may include Global PositioningSystem (GPS) location in the form of Longitude and Latitude, Date andTime stamp, description of up to 140 characters, as well as declinationbased upon magnetic or true north that will be packaged in anXML-formatted file with the phone's ID and a user name. Combined withthe video slice, the mobile application will send a “packet” 19 to thedatabase server 18.

The back-end mobile application 17 is comprised of a database server 18which serves to receive all data submitted by mobile devices 7 includedin the front-end application 3, and an optional subject matter expert(expert) 29 capable of reviewing submitted data for real-time use andorganized archiving.

The database server 18 further includes an archive database 20, a memory22, a processor 24, a video review station application 26 and a user webapplication 28. Image data and other data submitted to the databaseserver 18 via the front-end mobile application 3 are stored in thearchive database 20. The video review station application 26 is anoptional feature that may be included for use by the expert 29 forreviewing submitted image data and other submitted data. The user webapplication 28 is an optional feature allowing end users 30 to accessdata uploaded to the database 18 for personal use.

Multiple mobile devices 7 may be incorporated with the front-end mobileapplication 7. Each front-end application may upload recorded datasimultaneously to the database server 18. The database server 18 willreceive a transmission packet 19 from various mobile devices 7. If thisis a new transmission, the video slice and the metadata will be splitfrom the transmission packet and saved into a storage folder located inthe archive database 20. If the packet is a continuation of a currenttransmission, the video slice will be unpackaged from the packet, andmerged with the previously received video slice. In addition themetadata transmitted with the packet will be merged with the currentmetadata XML. If this is the terminating packet, the video slice will beunpackaged from the packet, and merged with the previously receivedvideo slice. In addition, the metadata transmitted with the packet willbe merged with the current metadata XML. Once complete, the video fileand metadata will be saved into the archive database 20. Finally, aconfirmation 27 of the received video can be sent to the mobile device7, confirming that the video transmission was complete. In turn, thisinformation may be made available to another application, web site, orother end user 30 for whatever needs it may have.

III. Database Video Upload, Review, and Use

In an embodiment of the present invention, an expert 29 will reviewvideo files uploaded to the database server 18 through the video reviewstation application 26. The video review station application 26 willcollect video from the front-end application 3. The application willgather the videos corresponding XML metadata and display the informationfor the expert 29. This will include items such as date, time, location,and video length. The expert 29 will then tag the event as a categorythat best describes the video (i.e. tornado, flood, thunder storm),apply search keywords, and modify the description as needed. The expert29 will then, using a set of defined standards, grade the video, such ason a rating of one to five “stars.” As examples, five stars mayindicate: the highest quality video; video of devastating weather; orvideo meeting predefined quality definitions. At this time the video canbe rejected if it does not meet video submission related requirements.Once this process has been completed, the expert 29 will save the videoand corresponding XML to the proper database tables, making it availablefor searching.

FIG. 2 demonstrates the practice of the above method in more detail.This will start at 31 when a phenomenon or event occurs at 32. A mobileuser will use their mobile device to capture video of the event at 34and will upload that video to the database server at 36. As explainedabove, the video will be uploaded in slices and will be saved to thearchive database at 38 for further review.

The database will check for raw video submissions at 40 and willdetermine if a new video has been uploaded or submitted to the server at42. If no new video data has been uploaded or submitted, the processcontinues checking the database for new submissions.

Upon detecting a new video submission, the video will be transferred tothe expert for review at 44. The expert checks to determine if the videomeets the back-end application requirements at 46. These requirementsmay include video relevance, video quality, and whether similar videoshave already been uploaded for a single event. If the video does notmeet all requirements, the video is marked as “rejected” at 48, savedinto a non-searchable database table at 50, and stored in the videoarchive database at 38.

If the expert determines that the video meets all requirements, theexpert will then grade the video based on standard operating proceduresat 52. The video will be categorized at 54 to allow for easy searchingof the video through the user web application. Categories may includevideo location, event description, or other defining terms that willallow end users to easily search for and find the relevant video.Searchable keywords are also added to the video at 56, which willsimplify the video search that will return the particular video beingreviewed. The video description will be modified at 58, if needed. Thismay be performed if, for example, the mobile user who uploaded the videoincorrectly described the video in question. Finally, the video will besaved to searchable database tables at 60 and stored in the videoarchive database at 38.

IV. Video Archive Service User Software

FIGS. 3 and 4 show the typical interface an end user 30 may see whenaccessing the user web application 28. The user web application 28allows all end users 30 to have access to all reviewed and archivedvideos available.

In the preferred embodiment, the interface is accessed through apersonal computer via the World Wide Web or some other accessiblenetwork. FIG. 3 shows a window 61 will be accessed by the end user 30.The window 61 includes a video playback 62 including a video title 64, aplay/pause button 66, a play-back progress bar 68 and a progress slider70.

Additional data uploaded along with the video data may be included inthe window 61. This data may include location information about thevideo, such as longitude 72, latitude 74, city 76, state 78, and country80. Additionally, date 82, time 84, and device ID data 86 may beuploaded and stored, embedded within the video data at the time thevideo was captured. Each of these terms will allow users to findapplicable videos relating to what they are searching.

A description 88 of the video, which may be written by the originalmobile user or by the expert 29, is included in the window, along with aseries of search keywords 90 assigned by the expert 29. The end user 30has the option of saving the video which results from the user's searchat 92. The video may be stored locally on the end user's machine, orcould be stored to the end user's profile so that the user may laterreturn to the searched video. The end user 30 may also perform a newsearch 94, including previous search terms with new terms added, or theuser may clear the search 96 and start a completely new search.

FIG. 4 shows an alternative search window 61. Here, the end user 30 iscapable of viewing the entire archived database list 100. In the exampleshown by FIG. 4, the video archive list 100 organizes the video by dateand category, allowing the end user 30 to browse through all videosuploaded and saved to the database.

Along with the video playback 62, video title 62, play/pause button 66,play-back progress bar 68 and progress slider 70, the window 61 includesa user video rating 98. This rating may be assigned by the expert 29 orby end users 30 who visit the site, view the video, and rate the video.The rating will allow future users to determine if there may be a bettervideo to watch, depending on what they may be looking for.

V. Weather Video Archive Application

In one embodiment of the present invention, the video uploaded to thedatabase 20 relates to current weather occurring somewhere in the world.The mobile user records video of real-time weather activity with amobile device 7, uploads this weather video to the database server 18where it is reviewed by an expert 29, and the weather video is placedinto the archive database 20 where it may be reviewed by end users 30through the user web application 28. This allows end users to view anup-to-date weather video of any location where mobile users areuploading video from, including in the end user's immediate vicinity.

The primary section of interest of the user web application 28 willlikely be an interactive map display showing various locations ofun-archived video and current weather radar overlays. The user will havethe ability to select the grade of video that is displayed on the map.Notifications of videos relating to specific locations will appear onthe map as an overlay to indicate the location the video was captured.Hovering over the notifications will allow a brief time lapsed previewof the accompanying video. Activating the notifications will display thefull video in a window 61. At this point the user will have the abilityto download the full video, copy link information to embed in a website, or other video functionality.

VI. 911-V Alternative Embodiment

An alternative embodiment video upload and archive system 102encompasses the use of a back-end application 117 that will take videocollected from a front-end mobile application 103, determine itslocation via longitude and latitude, and upload that information to a911V system server 118. If the location where the video has beenrecorded is within a current 911V application 128 site softwareinstallation, the video is automatically routed to the appropriateemergency authority 123. If the location corresponds to a 911Vapplication 128 site participant, the video is automatically submittedto that 911V emergency authority 123 with the location where the videowas recorded. This will allow the site to immediately dispatch emergencyservices as needed based upon what is shown on the video.

If the location is not a participant in 911V, a call center specialist129 contacts the appropriate public safety answer point (PSAP) 130jurisdiction, based upon the actual location determined by the longitudeand latitude embedded in the submitted video. The call center specialist129 will have the ability to email the video submitted to the 911Vsystem 118 to the PSAP 130 for review. All 911 or 911V contactinformation will be saved to the videos corresponding XML metadata, forfuture audits and investigations if needed.

FIG. 5 is a block diagram showing the interaction between the elementsof the front-end mobile application 103 and the back-end mobileapplication 117. The front-end application 103 is comprised of a mobiledevice 107 including a camera 104 or other image recording device, anantenna 106, a processor 108, a wireless network connection 110, memory112 including a stored application 114, and a position reference 113. Asin the preferred embodiment, the mobile device 107 records an event withthe camera 104 and transmits video data via packets 119 through awireless network 116 to the back-end mobile application 117. Positionreference 113 is necessarily included with the uploaded video packet 119to determine where the recorded emergency is occurring and to contactthe correct authorities.

The back-end mobile application 117 is comprised of a 911V system server118 and call center specialist 129. The server 118 further includes anarchive database 120, memory 122, a processor 124, a video reviewstation application 126, a notification method 127, and the 911Vapplication 128. The call center specialist 129 may review incomingvideo data and direct the video to the nearest PSAP 130, or the 911Vapplication 128 will determine the location of the uploaded video data,determine the proper notification method 127, and automatically forwardit to the nearest 911V emergency authority 123.

FIG. 6 demonstrates the practice of a method of the alternativeembodiment. The method starts at 131 with an emergency phenomenon orevent occurring at 132. A mobile user possessing a mobile device capableof recording and uploading video data captures the video data of theemergency at 134 and uploads it to the 911V web service at 136. Videoslices are stored in the video archive database at 138 as they areuploaded, and the system database checks for newly submitted raw videodata at 140. If no new video is submitted between checks at 142, theprocess repeats until new video is detected.

Once new video is detected at 142, the system determines the location ofthe video by longitude and latitude at 144. The system determineswhether the location of the uploaded video is a 911V site at 146.

If the site where the video was recorded is located in a 911V site, thevideo is transferred to the PSAP at 148 and archived as “received andtransferred” at 150 and stored in the video archived database at 138.

If, however, the location where the video was recorded is not a 911Vsite, the call center specialist or the system itself will determine theappropriate PSAP jurisdiction to handle the reported emergency at 152.The proper PSAP is contacted at 154 and the emergency is reported at156, including recording the call at 158 and adding contactdocumentation to the existing XML data at 160. All of this data is savedto the database at 162 and stored in the video archive database at 138.

It will be appreciated that the geo-location video archive system can beused for various other applications. Moreover, the geo-location videoarchive system can be compiled of additional elements or alternativeelements to those mentioned herein, while returning similar results.

It is to be understood that while certain aspects of the disclosedsubject matter have been shown and described, the disclosed subjectmatter is not limited thereto and encompasses various other embodimentsand aspects.

Having thus described the disclosed subject matter, what is claimed asnew and desired to be secured by Letters Patent is:
 1. A video archivalsystem comprising: a computer network capable of receiving andtransmitting data; a plurality of mobile personal computing devices,each including a camera, an antenna, a processor, memory storage storinga first mobile application, and a positional reference device; saidmobile personal computing devices wirelessly connected to said computernetwork such that it is capable of delivering data from said mobiledevice to said network; a stationary computing device including adatabase server with memory storage storing a second mobile application,a processor, and an archive database; said stationary computing deviceconnected to said computer network such that it is capable of deliveringdata from said mobile device to said network; wherein data istransmitted from said plurality of multiple personal computing devicesto said computer network and is received by said stationary computingdevice and stored onto said archive database in a front-end mobileapplication of said system; characteristic data embedded into each ofsaid slices, said characteristic data capable of identifying the mobilepersonal computing device from which said slice originated; wherein saidslices are stored in said archive database based upon which mobiledevice said slices originated; wherein said slices are stored such thatadjacent sections of captured video-data are contiguous; a computingdevice including a video review back-end application wherein said videodata is categorized and inspected by an expert, and results of saidcategorization and inspection are embedded into said video data; saidcomputing device video review back-end application including adetermination of location via longitude and latitude using videocollected from said front-end mobile application; said computing devicevideo review back-end application determining if the video is within acurrent site software installation, routing the video to an appropriateemergency authority with the location; and if said video is not within acurrent site software installation, routing the recorded video to a callcenter specialist for contacting an appropriate public safety answerpoint jurisdiction for an emergency response based upon the location ofthe submitted video.
 2. The video archival system of claim 1, furthercomprising: wherein said camera is capable of capturing high-resolutionvideo data; and wherein said high-resolution video data is stored ontosaid mobile personal computing device memory.
 3. The video archivalsystem of claim 2, further comprising: said high-resolution video datarecorded and stored in slices, and wherein said slices are between oneand ten seconds long; said first mobile application adapted to instructsaid mobile personal computing device to transmit said slices to saidcomputer network; and said stationary computing device adapted toreceive said slices from said computer network and stores those slicesonto said archive database.
 4. The video archival system of claim 1,further comprising: wherein said mobile device processor producesdate-stamp and time-stamp data when said high-resolution video data iscaptured; and wherein said date-stamp and time-stamp data are embeddedinto said high-resolution video data at the moment said video iscaptured.
 5. The video archival system of claim 4, further comprising:wherein said positional reference device is a global positioning system(GPS) capable of reporting geographic coordinates; and wherein the GPScoordinates of said mobile personal computing device are embedded intosaid high-resolution video data at the moment said video is captured. 6.The video archival system of claim 1, further comprising: a remote userapplication stored on said stationary computing device and accessible byremote users connected to said computer network; and wherein said videodata uploaded to said archive database is accessible and viewable bysaid users at remote locations.
 7. A method of archiving data, themethod comprising the steps: providing a plurality of mobile personalcomputing devices, each said device including a camera, an antenna, aprocessor, memory storage storing a first mobile application, and apositional reference device; providing a stationary computing deviceincluding a database server with memory storage storing a second mobileapplication, a processor, and an archive database; connecting saidmobile computing devices and said stationary computing device to acomputer network; capturing mobile data using said mobile personalcomputing devices; transmitting said mobile data from said mobiledevices to said computer network; receiving said mobile data from saidcomputer network with said stationary computing device; storing saidmobile data onto said archive database; embedding characteristic dataembedded into each of said slices, said characteristic data capable ofidentifying the mobile personal computing device from which said sliceoriginated; storing said slices in said archive database based uponwhich mobile device said slices originated; wherein said slices arestored such that adjacent sections of captured video-data arecontiguous; providing a computing device including a video reviewback-end application wherein said video data is categorized andinspected by an expert, and results of said categorization andinspection are embedded into said video data; said computing devicevideo review back-end application including a determination of locationvia longitude and latitude using video collected from said front-endmobile application; said computing device video review back-endapplication determining if the video is within a current site softwareinstallation, routing the video to an appropriate emergency authoritywith the location; and if said video is not within a current sitesoftware installation, routing the recorded video to a call centerspecialist for contacting an appropriate public safety answer pointjurisdiction for an emergency response based upon the location of thesubmitted video.
 8. The method according to claim 7, wherein said camerais capable of capturing high-resolution video data, the method furthercomprising the step: storing high-resolution video data onto said mobilepersonal computing device memory.
 9. The method according to claim 8,further comprising the steps: transmitting said high-resolution videodata from said mobile device in a plurality of slices, wherein eachslice contains between one and ten seconds of video data; and storingsaid slices onto said archive database.
 10. The method according toclaim 9, further comprising the steps: embedding characteristic datainto said slices, said characteristic data identifying the mobilepersonal computing device from which said slice originated; storing saidslices in said archive database based upon which mobile device saidslices originated; and storing said slices such that adjacent portionsof captured video-data are contiguous.
 11. The method according to claim10, further comprising the steps: producing date-stamp and time-stampdata at the time said high-resolution video is captured; and embeddingsaid date-stamp and time-stamp data into said high-resolution videodata.
 12. The method according to claim 11, wherein said positionalreference device is a global positioning system (GPS) capable ofreporting geographic coordinates, the method further comprising thesteps: producing GPS coordinates using said positional reference device;and embedding said GPS coordinates into said high-resolution video data.13. The method according to claim 10, further comprising the steps:providing a video review application capable of accessing saidhigh-resolution video data; providing access to said video reviewapplication to an expert; receiving categorization and inspection datafrom said expert; and embedding said categorization and inspection datainto said high-resolution video data.
 14. The method according to claim10, further comprising the steps; providing a remote user application;storing said remote user application onto said stationary computingdevice memory storage; providing access to said remote user applicationto a plurality of remote users; and allowing stored high-resolutionvideo data to be viewed by said remote users via said user application.